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ABSTRACT 


A Unoar stochastic model ©£ the human operator la developed 
and applied co the problem of piloted control of an aircraft. The 
pilot and aircraft are modeled ae linear time- invar lent systems 
containing both process and measurement noise. The loop closure by 
the pilot is determined by formulating the problem as an optimal 
stochastic control problem. The solution to the optimal control 
problem yields not only the pilot's optimal control output Which he 
use- to control the vehicle , but also the optimal cootoinacioo of hla 
observations of the vehicle states upon which Che pilot basso his 
control. In addition, a method is presented so that, using experi- 
mental pilot vehicle data, the cost functional which is minimised in 
the optimal control problem will be numerically equal to tha Pilot 
Rating (PR) that the plloe would associate with tha given vehicle and 
task. 


I. INTRODUCTION 


The purpose of this paper is to show how the techniques of 
modern control theory can be applied to the problem of defining the 
closed loop dynamics of a pilot controlling an aircraft in flight. 

The pilot end vehicle ere modeled ae linear time invariant 
systems containing both process and meaauramn t noise. The loop 
closure by the pilot is determined by formulating the problem as an 
optimal stochastic control problem. The solution to the optimal 
control problem yields not only the pilot's optimal control output 
which he uses to control the vehicle, but also the optimal combination 
of observations of the vehicle etatee upon Which the pilot bases hla 
control. In addition, e method is presented in this paper so that, 
using experimental pilot vehicle date, the coat functional which la 
minimized In the optimal control problem will be numerically equal to 
the Pilot Rating (PR) that the pilot would associate with the given 
vehicle cask. 

Because of the use of the etate apace notation of modem control 
theory, the impact of thle paper is much breeder then the field of 
pilot vehicle control; whet la presented is the methodology 
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defining operator control of any dynamic system which can be 
reprueontmd aa a linear time- Invariant atachaatic system. In fact, 
tha theory can be readily extended to linear time-varying aeoebaetltt 
ayaeana. Refs ranee 1. Furthermore, the mathematical operator 
deaeriblng the pilot can alee repreeeae a nonbuman operator ouch ea 
a monkey, a fixed order observer (ala Luedberger, Reference 2), or a 
fixed order compensator. Reference 3. 


IX. VEHICLE DYNAMICS 


It la aaaumad that tha vehicle to be controlled by the pilot cam 
bo represented as a linear time invariant atoebaatlc aye tom ee follows i 

B* ■ Fx ♦ Qu ♦ Mn (1) 

where x la an nxl column vaster of the system autos, u is a nxl 
column vector of the controls, and q la an 4x1 column vector of white 
noise inputs with autocovar lance B (n(e)n(T)) - x * 6(t-t). In this 
fen, aquation (1) can easily represent an aircraft flying in turbulence 
(Boa References A, 5, 6, end 7 for e derivation of those equation#). 

The pilot la aaaumad to "observe" or "foal" acme incomplete linear 
combination of tha system states whl«*h have bean contaminated by an 
observation noise, u. The pilot 'a obi vatlon, y, la written as 

y - Cx + p (2) 

To Simplify tha aquation format of thle analysis, we a** urns that the 
observation noise, u, la filtered whits noise. If it la desired to 
retain the white noise characteristics, the filter bandwidth can be 
made much greater then that of the controlled system of equation (1). 
Then, using tha techniques described in Reference 7, the controlled 
system would bo 



whore the observation la now expressed ee 



The matrices Pp and Mp art used to define the bandwidth and intensity 
of tha observation noise. 
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The ft,.*! atop la the alnpliflcation la to rodafina thf matrices 
la Equations . and (4) by 



Than wa eon writ* tha following sit of 
eoaer.lt 


)# — W 

- C*ii] 

aquation* for the vehicle under 


variable* Thu*. will m , tv? a*/*. * %tt£ (whlab claaaiaally 

"cauae#" a J) unlaaa Da m aantrolUnt a *7*60% *'-•«*• drusAlu art dt 
latte toeoad ordar or frame at. Thus, tha $ cam apparently fa«ar*t*d 
by ebt load la rttlly toolbar tttea of eba ayetan which uw readily b# 
Included la eba obaarvetim. vactoi » y , of Bqaaeioa (7)* 


xv. pilot ratios dyhmucs 


Tha satined pilot vablala dyatalaa tra aaally aspreaaad using 
Sqaaeiana (6), (7)* tad (0># Tba ca r lo ad ayetan it 


E& • Xx ♦ Ol + Mh (0) 

y * Cx <7) 

wbara tha observation nolsa la now Included la tba tyatas aquae loot. 
This ays tan rapraaantad by Equation# (6) and (7) la aaauwad to ba 
controlled by eba pilot* 


XII* PILOT DYNAMICS 


Tba pilot dynanlca ara rapraaantad in aeata variable notation 
and ora baaed on eba pilot nodal developed in Reference 7* Tba pilot 
nodal la 

Bp dp • P p *p ♦ Op Up + Mp n p (8) 

where xp la an ral column vector of eba pilot’# state#. Up 1# a qal 
column vector of tbo Input control# to eba pilot nodal, aad np la a 

txl colaan vector of white oolaa input# wltb auteaevarianea 
B <np(t)np<T>} - p « e(t-r). Tba natrln p ia used to aaala eba 

Ineanaley of eba pilot* a not or nolaa. 

Several differ enema can be noted be twe en this pilot nodal and 
that of Raforanca 7. Tba control input to tba pilot nodal, up, la 
axprasaad In s norm general fora rather ebon in tba pure observation 
vector fora of Reference 7. This la to allow up to ba axprasaad aa 
an optlaal control input to tba pilot nodal s tbla will baaana 
evident later in eba paper. Tba other difference la that tba tlaa rata 
of change of tba obaarvetlon vector la no longer Included* Tba 
rationale for eba exclusion of tbla tarn la baaed on tbo claaaloal rule 
of tbuab, Raforanca 8, that tba pilot will 000b to drive tba oloaad 
loop dynaniea to a k/a fora, wbara a la tba conventional Laplace 


N N ■ 1$ N * N N 

Tba obaervation vector for tbla aye ton is 

M- M N 


(9) 


(10) 


To alnplKy tbo writing of tbo no-load pilot vablolo dynandao, 
tbo following now pilot vobialo etata voctov, g, end netrlcoo ara 
defined to ba 


1 

? • 

fel 

» 5 • I 


M 

1 

r 

9* | 

h 



tu> 


With elMN dallnitlOM, BqMtloa. (9) Md (10) blMW 

n • f? ♦ ft ♦ » 

y ■ Ox (IS) 

Equation# (12) and (13) r ap t aa ant tba opon loop pilot vablala 
dynanlca. 


Tbaaa aquati 


(U) 


Lena can aleo ba written oa 

i • a ♦ i* ♦ w 

i • 9S 


US) 



where 


A . E _1 - , B - f l C , N - (16) 

2 

The matrix E will have an inverse whenever X + II. 
Reference 5. xa xx zz 

The structure of the control vector , u, which will determine the 
closed loop dynamics, will be e function of the pilot vehicle control 


V. OPTIMAL PILOT VEHICLE CONTROL 


The control vector, y, that la aalectad by the pilot will be a 
function of the pilot vehicle control Task. The work of Rlelnaan 
(Reference 9), Anderson (Reference 10), Dll low (Reference 11), and 
Paakln (Reference 12) have Indicated that the satisfaction of the 
control task can be thought of as the selection of an optimal 
control, y*, which minimizes a particular coat functional, J( that 
coat functional being determined by the control task at hand* The 
optimal control, y*, that ia selected by the pilot can be aeen from 
Equation (11) to b# a combination of the optimal controls u* and Up*» 
Recall from Equation (9) that u la the control that "operates" the 
vehicle end up la the control that "drives" the pilot. The pilot, 
therefore, la selecting both tils optimal Input, Up*, and hla optimal 
output, u*. as he attempts to achieve his pilot vehicle control task. 

Two potentially viable forme for the cost functional will be 
given in this section of the paper. The validation of thaaa 
functionals will be left to experiment a . These forms are directly 
motivated by the independent works of Rleinaan and Paakln (Rafarencea 
9 and 12) who obtained experimental verification of this general 
approach the select Ion of coat functionals. 


J - f (?. u ) 

The first coat function la written assuming that the pilot 
minimize* soma function of the pilot vehicle ay at am observation 
vector, y, and the pilot vehicle control vector, y. Thus, J la 
written a a 

J • e£ [y f (t) Q x y (t) + u*(t) Qju (t)]J (17) 

where E {•) la the expectation operator, Reference 13. 
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The control teak for the cost function Equation (17) is: 
given tbs pilot vehicle system from Equations <H) and (1$), 


19 

<M> 

jr • Cx 

<19) 


Find tbs optimal control, y* # where y* Is restricted to fam s 
linear confc last ion of tho pilot vehicle system observations 

tf* • ft (20) 


such that the coat functional, J, of Equation (17) Is minimised. 

Thus, for J • f <y, y), tho optimal control will be, from Equation (20) 



Equation (21) can be expanded to give 


u* • Hy ♦ Hp Xp 
up* - Ky ♦ Kp Xp 


( 22 ) 


Equation (22) can be interpreted in the following manner. Through 
the control up* tbs pilot sets up a linear combination of his observa- 
tions, Ky, and adjusts his own dynamics by feeding back some linear 
combination of his own states, Rp xp, to aid in the optimisation of J . 
In addition to this, ha controls tbs vehicle through the control vector 
u* with a linear combination of hla observations, Hy, and hla states 
Hp Xp. In other words. Equation (22) says chat the pilot will adjust 
hla input and output simultaneously to obtain optimal control over tbs 
vehicle. This Is shown in Figure 1. 


The solution for the matrix H of Equation (20) la not trivial. 
However, methods to achieve this solution are available la References 
1 and id. 


J • f (*, u, &) 


A slightly different approach la necessary whan the coat 
functional Includes the control rate (Rlelnman'e coat functional. 
Reference 9, includes control rata). Kleinmsa has shown that the 
introduction of control rate in the coat functional for a multiple 
input-single output pilot control took will effectively Introduce a 
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FIGURE I - OPTIMAL PILOT VEHICLE 
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VI. QUADRATIC WEIGHTS TOR PILOT RATING 


This s set ion will address the problem of determining the elements 
of the quadratic weighting matrices from experimental test data. An 
additional goal la to show how these weighting matrices may be a lead 
so that the numerical value of the cost functional will He equivalent 
to some press signed scale of measurement such as Pilot Rating. We 
begin with the general coat functional 

J • E ^ llB (x* (c)Qx(C) ♦ u'(t)JU«<t)J J 

rut , ii> , 7 

• E ) [x (t)Qx(t)] + [u (t)Ru(t) ] / 

1 t**» fr** * 

kB f^ Ix’(t)Qx(0]J +tp tB (u'(t>Bu(t))J 

• trac. Q (x‘(t)x(t))J j * tree R^ 

... 06) 


J - tr <<») + tr <R0) (37) 

where X and U are the steady state cover lane 9 matrices for the states 
and the controls, respectively. We now restrict Q and fi to be diagonal 
weighting matrices 

% 2 <0) r ir 2 (0) 

Q- '• , B- \ (38) 

(°) |f®> 'fa. 

Than the trece operator In Equation (37) will pick off the diagonal 
elements of tbs covsrlsncs matrices to give 


J - <Vt *u> ♦ (r 3 Ujj ) 
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uhare x lt and ujj are the diagonal elements of the covariance matrices 

X and U, respectively. Now because X and U are covariance sat rices, 
it is well known. Reference 4, chat the steady ratejroot seen square 
(nas) values of the system states and controls u j , can be expressed 



Thus, the performance function can be expressed in terns of the 
weighting coefficients and the steady state rms values of the states 
and controls. 


J - l (4i *i 2 ) + I (*1 “j 2 ) <* l > 

1-1 J-l 

Since the rms values of the states and controls can bs measured 
from experiments! data with a pilot In the loop, wa now address ths 
problem of choosing the weighting coefficients. 

An example will now be given to show bow the weighting coefficients 
can be selected to predict pilot ratings. 

In the development of the "Paper Pilot” approach to predicting 
pilot acceptance of aircraft handling qualities, Anderson and 
Dillow (References 10 end 11) have shown that the pilot will adjust 
his gains and model parameters to minimize a cost functional which, 
for most cases, is numerically equal to Pilot Rating. Ths “Paper 
Pilot" rating functional consisted of a weighted linear combination of 
the root mean squared (rms) values of ths vehicle states and ths pilot 
"lead” terms. The pilot rating functional proposed in this paper le a 
weighted linear combination of the square of the rms values of the 
vehicle states, the pilot's states, and w>e controls. The selection of 
the use of the squares of ths rms values la computationally mors 
attractive since values are merely the diagonal element of the 
covariance matrix solutions to the closed loop, eteedy state optimal 
pilot vehicle svatem. The selection of ths rms aquarsd values, 
however, is further motivated by the work of Schmotzsr, Reference 15, 
where the handling qualities for F-4C and F-80 aircraft are shown to 
be in direct proportion to the roe squared values of the aircraft 
states when the aircraft are being randomly disturbed by aerodynamic 
turbulence. 
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Assume that t experiments are conducted and for each experiment, 
data art eolUcted on ataady state rms values for the states end 
controls, and the associated Pilot Ret log (PR) is recorded. We would 
then have for the t experiments, using PR for J in aquation (41), 

”<» * “ * J x q i **U> + “Kl) 

ra (l) * * + j, <1 *1(2? ♦ j x *)®J(2> <«> 

» 

"<t> • • + j l <1 *i (e) 2 ♦ j l i r, r {t 2 

where a is s constant bias term. Tbs notation in (42) can also bs 
expressed in matrix form by factoring the weighting coefficients such 
that 
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or 


[PR] - P q (44) 

where (PR] Is a Cxi column vector of the Pilot Ratings, g is a txl 
column vector of the weighting coefficients, and £ is readily identified 
from Equation (43). It can be shown that the best fit with respect to 
"least squares" or "minimus norm," Reference 16, is 

3 - ? + l PR] <*S) 

where P* la the generalized or pseudo Inverse of P. 

Now t it should be evident from Equation (43) chat is Is not 
necessary to weigh or measure every state of control. The form of the 
cost functionals associated with Pilot Ratings and the nonzero 
weighting coefficients will be a function of the particular control 
task. Thus, if the coefficients of the weighting matrices are choeet 
using Equation (45), the solution of the optimal pilot vehicle control 
problem, as posed In this paper, should produce not only the predicted 
closed loop performance but an associated Pilot Sating of the vehicle 
dynamics as well. 


VII. CLOSING COMMENTS 


In this final section of the paper, 1 will mention some of the 
present shortcomings of this optimal pilot vehicle control theory and 
then document some of my thoughts on where we could go from here* 
Obviously, one primary deficiency la that the theory has not been 
dlrectl/ validated by experiment. The formulation of the theory is, 
however, based on an integration of ideas from all of the listed 
references and should work. 

The reader may have noticed by new that no guidelines have been 
given to determine the size or order of the pilot model; this is a 
present shortcoming. My guess Is that the order of the pilot model 
will be a function of the desirability to obtain an open loop pilot 
vehicle system which is completely controllable and completely 
observable (See Reference 16 for a mathematical system definition of 
these terms). Kynaskl and Chen, Reference 17, have suggested that 
the pll?t model be considered as a compensator and that the order of 
the pilot model be determined just as Brasch and Pearson, Reference 3, 
determine the order of a compensator necessary to achieve system 
stability or pole assignment. Perhaps, the most direct way of 
determining the pilot model order is to use the classical pilot 
vehicle approach; pick a low order model from those given in 
Reference 7, try it, and see If it works. Part of the motivation 
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behind the development of a new approach to Pilot Vehicle Control 
was the need to have a pilot model whose structure was simple enough 
that the Individual parameters of the model could be identified 
through experiments. This Is the primary difficulty of the approach 
of Klelnman and Pas kin where, because of the modeling of the pilot 
as a Kalman filter, the dynamic order of the model is necessarily the 
same elze as the order of the plant or vehicle under control. In 
these cases, the validation of the model can practically be done only 
on an input-output basis and not through parameter i dent if ation 
techniques . 

Another handicap at tVs time is that a consistent method does 
not exist for determining r .* pilot's motor and observation noise; 
call the whole tiling remnant if you like. However, Klelnman and 
Paskln, References 9 and 12, have made some progress in this area- 

Scallng the cost functional to be ntnerically equal to the 
Pilot Rating oust be approached with caution. Ideally, one should 
be able to select a set of cost functional weighting matrices which 
will be valid over e given dess of vehicles for a particular type of 
control taek. As an example, the weighting matrices should be 
Invariant for cargo aircraft in a landing approach task. The future 
of optimal pilot vehicle control looks very promising. One immediate 
application of the theory is in the direct assessment of aircraft 
handling qualities. With this optimal pilot model it will be possible 
to evaluate an aircraft over preplanned "stability and control" 
trajectories. The trajectories can be constructed as either fixed 
point or time varying linearized segments of actual nonlinear 
maneuvers* 

The use of the state space formulation in the development of 
this optimal pilot vehicle control theory enables the rapid coupling 
of tins theory with the design of automatic control system utilising 
optimal control theory. A successful design effort of this type using 
more classical control techniques has been accomplished by Hollis. 
Reference 18. 

One final comment is Included for the engineer concerned with 
basic control system design. The matrix equations of Equation (8) 
which describe the pilot dynamics will also mathematically describe a 
fixed order dynamic compensator network or an observer system in the 
sense Luenberger, Reference 2. Thus, the optimal control developed for 
the pilot dynamics will also be directly applicable to the design of 
compensators or observers. 
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